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Mapping Perceived Depth to Regions of Interest in 

Stereoscopic Images 

Kidk HoUiman 

Department of Computer Sdeaoe, Universily of Durham, Durham, United Kjngdom 



ABSTRACT 

The nsable petceiwd depth taki^ of ^ stereosccrpic 3D display is Bimted by fanniaii factcas eonsideniiUoad tO ft 
defined range axo-uad tho acF^eA p^a^o. There thorafore a need in stereosccpic ixiias^ cxcatiaa to map depth 
fi»mth©scQnfitoaMxgfirt:d5spUyiftrlthoute3aS66d^ Recent bnago c^ture mertihods provide proctee 

control over this depth mapping "but map a ean^ range of scene depth as a whole and are unabfe to 
preferential atexeodcopio Mips«S«<ktdtiO(a to & pacUcixUz return of interest in the scene. 

A jacw ejyproadi to stereoscopic ima^ creatisn 19 dwrih«d thftt v^k^ ^ defined iC^oa of artwest in soeno 
depA to have an hnprovod p«toBlved degoth repicsentation oompaiod to other i^ons of tiie scene, R» esamplo 
in a ^fitme this may be the regJon of depth axoimd a game charaotet, or In a sdentiftc visualization the to^cm 
axound a partieolBr Sestuxe of interest. 

Tb realise this approach prtseirt a novel al^rithm far stereoscopic image capture and deseri^o an Impl^ 
m£&tat!on for the widely Uded xay-teacing package POV-Ray. Resulte demonstafate how thSa aytptwch provides 
consent crfiatora with improved contol over pepcelved depth i^eseaataiim in stetfeoscopio imaged. 

Keywordej Graphics Systems, Hnman Fajctots, Renderings Virtual lUaii^^, Stercoe<»piC» 3D displaaf 

!• INTRODXJOTION 

The properties of fitareosco]^c dispiayft ft^mCly pxeetat a Aallenge for contant creators vritih. many sgen^ 
^frfyifiiTig a larger deipth range thaa ar3D diaplfiy Oto present to the viewer. Ebr esamplo, trials nmng a hi^ 
qyallly desktop aato-stereosoc^lc SD display by Sharp Coapowaon^ denK>nstrate4 that the range of ^^ajjatole 
perceived depth range could be as Uttte as f-50fma,+60mm] m-fecmt and fiebmd the eis^ fiaafiwe- These 
limits are generaHy understood to xOttAt feom a combination ^ faetom inchidfog the display la tevel of infcer- 
diannel crosstalk.^ tha quafi^ of tha etereoacoirtc images* and tiie a^ 
into a single Smagd. 

Mgj^ methoda hsro bom proposed to control how scene depth is captured la a stereoscsopic imag^ The 
problem eaa bo ocmsldearod a mapping of sceno dqpth onto the available porcdved depth, raiigo on the tjargst 
stesQOSOOpic disFpli(y as shown in figure 1(a). aecent solutioatt art able to gnazaatee thSs maj^ing baa certain 
prtrpertiea, for example that the pesoeSved d^tb will »ot exceed pwwieflned ranges and th^.the perc^ved dapith 
lemfOns constant when th«e is head movcmwst. This has wsuhad in beneBts conteiit create 
d<£no the scene dfiqpth rango they wat to capture while behig sure that this wffl be r^roduoed as €sspeeted.on 
the target dlsjOay Eijqp«ience gen«Btlng images using one of these methods^ was posl^; it aUowed novioe 
3D dispby users to have repeatable control over the depth, mappang from scene to displajj^ im»^ A» a result 
content production using computer graphics and digftal photography no lon^ required repeated trial and error 
to produce an Image wfth defined stezeoscopic deiptih properties. 

Howovei, cuiwxrt sohitioas to stercosoopSC imagje eapturo hsve drawbacks duo to Urn fact that thisy yn^ a 
filn^ range of scene depth onto the target dis^iey depth range as a whole. If the scene depth rangp ia larger than 
the available display d^^th range thid will result in comirasbn of perceived depth, as in flguro !(*) TOfl bas 
the conaqu<mce that a retfon of inter^t in scene deptb cannot be gnaxanteed a, good toprewatatton in percokvad 
- depth in the display^ imaga 

EVuther' author infimnatiOD: {fiead oorapoideBce to Nlc^ft HoUlman.) , . . 

Bmedlj p «4]iolIimanedarham4ie.iik, Tdtkphoae- -f M idi 864 IT^I, Web- htt5)V/www.a»rhamjus.ul^n^lMinSa^ 
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Figure i.S«immopto&aeiaea«aptttf6mAa^&&^^ (a) Ebdcjaxig methods 

tOBp a defined range of acooAdepfth to rStA WAbl« dSdplay perc^iv^d dojptb m ft whoiok (b) The nevr algorithm d^pth 
cli£femx3t|7 in thzea reslonsk nsar »£Soii(>fR}, region of hiCMftt (BOI) ezid &x r^lon(PIl] allotviD^ tho ot^lable fiteraomi^c 
d^pi^ raassto be ^Ut dltiSsxaat^ bctneeu Che tSwae v6gio]ftS» lot 6K&ini>U» ad dhdivs tha HOI zx2&y be giveoD libe be&b«ta» 

Our norw approach to d<splk mapping allows tho content creator to d££n& d^cste£& m^ppvcte^ &oia xoal ficcaoe 
'depth to percdvttd dS^ky depth £^ thr6^ dd&rent lanses; a region of intexfist (ftOt) in the scene and & n^ 
region (NK) end far regioa) (FR) in the scene, es shown in figuxe I(l>). AU three regions can bo mapped to a 
differmt proportion of lAie available perceived despth ran^ cm the.tax:get 3D dii^lay The result Is ^^^t tb& 
creator, can choose to gi^ battcs dtoreoscopic x^presentation to the KOt oos\pared to the.noar and Sax teg^oiid 

Wo^'aln» to refcdn the soene outside the r^jgioa of interest^ rather than- clip it or dia^iii&e it by blurring^ because * 
In many applications it is Imponm to dO0 ccnteoct axDxmd the region of interest. For example in a game, or 
ofther interactive appBcacSon, it C£iil be nupoxt^ to see ixato the distance to chec^ to coxnins» but It is not 
important to haora this i-epr^s^t^ udiog high jsesohitbn jimdcved stereo dcrpth^ paxticuiar]y Tvheii other d^t^ 
cu£S3 are available.* ApplicatiOTiaihat wall bone^ £rom the nenv a)gpi^^ axe printari]^^ those that are coxnpixter 
Sraphics baaed and include computer gamesi, medical, scsemtlflo and Inibmiatioii visualisation. 

2. B ACKGDEtOUND 

1^ b^c^ta piroyiddd by stcxeosoopSe di^pla^^a axe wSL Icnorwn^^ and Include; d^pth perception ^ol$tive to a 
dSs^Hisy mjattMA^ perccptitin of Btructure In vi8aa% co<t^)e9C eoenea^ hnpiovod perception of suirfeee ourv&tura, 
Siupxov^ motion Judsomcnt and bnpro'ved' pcrooption of surface material type. TlMse benefits have been to 
abo«^ to bo helpful in providing users a better, undmstanding or ^spreciation visual Informatroin ha a can^ 
of studies ih di&rsnt appitcation domaiua ^* 

An. Imp oxtant s^pp in- obt£iinhig these booeflts Sa to use high QuaUl^ 3D diapU^ with, good baaSc £D imti^ 
quality (brigbtnc$9, ooaoftiadti high zeeohitioa, ftiU cobuTr moving Smagss) aa 'wall as good SD Smage quality (image 
cikans^we]lallg<^$patld]y,]nbrig^ Sudidi^li^a 
axe becoxnSx^ avaDaUe far desktop and laptop PC dystemd firdm conipenies fnchidixig DimoiaSoa l^cfanolo^ies, 
Stereographies, SeoRoal and Sharp Qorporation.^ 

Fbr the user the goalie of thd st^ecscQpic ImaQfi pair ia at least as important as the quali^ of tho dSaple^K it ia 
preeentedon. Tho imtige pair needs to be captured with al^ed cameias 

and to have mvAimal difieranoes m hmunanc^, coxibraat, focus and magiificstian. Synthetic computer graphics 
ey9t$tt99 ezo better than optical phctoigraphie ^sterna hi this i^cct as the ima^g pxoc^ ;3 not affected by 
physical aTignmc pfc difierenoca betwcoai tho two capture channels. Fbr all stereoscopic Smage capture methods a 
lay raquSremost is to control (ho d^vnt of pOrcolvod dep^ seen when the ima^ is di9pto>ed on the targ^ 3D 
dii^lay aa tlds direct^ affcfits the vieti«er*a al^lity to perceive a oomfortBblB Based 3D imOi^ 



IB. Dec. 2003 16:08 



No. 7187 p. 7/17 




2-1. The Geometxy of Perceived Depth 

J>^p& ^i«cptiOa in plan&r stereoscopic Smzges lias been xviddy studied and tie gcsom^ay pt ataiooscopic depth 
p^x^tSott 5d weD known.**^^"^ Tha vcm^ di^pari^ captured whwa a stereo ima@3 pair Ib created beottmes 
pto^cal $cr«n disparity when the gteeo pair Ss displayed on 6n electaponic SD display. The screen diapadty h 
detected by the rotJML end toterpreted tho tadn ad ^ perceived depth m-fitnifc or behmd the screen piano, es 
sEiDSfn hi figure 2. 




p.peredveddeplh 

SBpaisflon 
dlBaaanidspartiy 



Figure 2p Geometric pereehwd daptb tor positfve, (1), wid iMSSpvtNes i«re^ dl^>arily. 

While a viewr's aetttel p^irception of depth resulting from ft gjvea seroea disparity tmportont iro adopt 
the cammai iippra»di!»$*l<m of geometeric. perceived d^th ^^'^.aa. i& xhSs Sa cffllcttla«ed, as shown in figure 2, 
&om the valno SOrtto dtepwity the ^cwer perodroa and It Ib cunently thought to provide a good wocldng 
^pkCodbBiaiSon to the iden^e eetu^ paroolvbd depth. 

Aff&Oted ett^therangeof^pdehonldbelixnitedif the^ com^ortab^ fizse & stisreo imag^ pelr.^. 

In CUff pia>or we ad^ & taxset ajprfaange eiieund Oie dteplay plans of [-a6mm,+fiomml as a eonaesrviktftve, but 
uboIqL ransB Anr vsras wliih norfnel stsreoso^ vlBlon, viewing a desktop stereoscflqpie display. 

2.3. Giirrent Approachaes to Stereoscopic Image G^eneration 

Thb ^encret&on of bl^.qualily etereoscopic ima^ has received auhstandaal iatcreefe 9^ receafc .methode htsvt 
e^eved niwr quality leveh. Biecent raviswa of l£e ^terairoxe can bef^nnd ia eevecei paWicwttoaas?'*'*^** and 
here ^ brleay review two approaches^ analyBing one m mgro d^e^l. 

WartoQ^^'^ studied the dSstortiona iA gpd due :to fSBcaasA BSSumpBona lAkOOt the Imk bcftweea eye sopaxatkm 
and camera placement when ©anerMudig hnt&s for head tracked steareoscppic dSaplaya Methode to remove part 
or eH of these distcrtlona hy pie-distorting the scene usnig a dffiitfti trans&armation matrix ivere presented. 
Thm m^thad^ wrlted well biit the best y^as complex and <mly easily applied to the gaaeration of co mpntffl c 
grephies Smas^. ha. addition these methods coxmdeKed the econe ae a whplo Md wqxq imablo to slve prefcrcaicSa) 
treatment to a particnlar regloao^of intere^ 

Jones et al* presented a method capable of controlling gpd appHcahle to content creation conapiiter 
gtfiphics c££ digSwa cwwerae. The algorithm mhipa scene depth to perceived display depth as fliuBeratod In fig- 
ure l(aV Kcarewlffia: limits of a rfngk range of scene dei^ are identified and the ajgorithm maps those 
to be mtWn the deanodflj«Jran^ of the target 3D display (bottom). The problem of diooaing a atea»o camera 
fieparatlon Is removed ftom the user as It is atttotnaticsUy calculated, along irtA other parameters, to achSeve 
the reqnixod mapping between scene depth and peroaivod di^ley doptb. 
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fiOSBO depth «d; in the l]typfi]tt£Qpi«o^(b] acene d«aik ia eompregaed Into BeittHnbla gpdt^s^ ahA fw tV* T^yp#BWy<f 
QCKW (<d scene dQith la eiqpaAd^ Sxtto tikd fics^aUo APti 

The ttsialt of Applying the Jones algoTitTvm to tzmp cEli fa Kax t sooiie dqpth raaages to the same tpotff^ gpd is 
lUusoratcd io figura 3. Thi? v$e9 target display parameters similar to the Sha^p ]fCD3D display and assumes a 
nominal viewing distance of 570mni^® and & target gpd of [-63,+S6] around th<) screen plane. In figuic 3(a) the 
ficonc depth TTifltrhf ^ the gpd target and thaie Ss a OXie-to-one cozrespdsndencc b.eimi'BGa the two. W$ o^ tj ef^pect 
tho viw$r will sea Tnlnttnal difiersoice between p^oeived depth m the original scene and on the display as long as 
the 3pd target la kept ^tl^a f'anian'a fosionat area fi>r the target d&play. figoce 3(b] the scene dti3E>^ rai^e 
eaptuved is fiieattt'thaa th^ jg^ taisst and there is pzedieted & compression ol the scene deplih; here the viewer 
S9 UkoSb^ to pmolve di^rete objeets to be closer togotiher on the display than in the oxis^tnal sfie no. The ^posite 
ia predicted in figure S(o) where the" so^e depth ia smaller than the 9pi tarijet and there k an OKpansion of 
aeeoQ d^th; here tiie viewer Is likely to perceive discrete objecta ferchor apart On tho disfpl^ than io tho original 
scene. Previous studied and our esqcxsrience sxxggcst these effects are apparent and we note i^ almost all cases 
wbsn creating 3D COfitent tho sc^e, dqpth is either compressed ^ o;cpwded irhen viewed on a 3D display. 

'Con^dedng the case In dgnre 3(b) yAum ecesns depth is oompxcssed; an orii^nal range of [370. 770) is com; 
IKcese^to ^ Qpd of jndt 025]. Jn this case & particular region <A iix(ezeai> in the bcoxie ta at risk of receiving 
* relatively 'UtiUe atsceo. leipresentatSp^ i:a ti^ displayed dD ixoage. For exan^ld, a region of ijlterest in the scone 
of ^11^69^1 wm be- ngnemited td'tbe vi^war by & ^ wws* of ^69,69/] a. depth eompres^n by & ^lOtor of 
approsdiaasety fourteen* 

lb snmma^ the goazantee the Jonee^ aigorlthm not to eoceeod pre^efix^ed ranges of s^pd enseicB thitt the 
viewer nev«r so38 <«bcus]ve depth oa tbe dl^l^ treating^ the seena as & whole. If xh$re ie a epedfio region of 
futciMSft Sn a. $oeAe then it cotmot be-tfyen batter fitereoseojde ttipnwmil atlQn than other regJosB of .thfrseotto. In 
addi tion if the tcjrtal seene depth t^ge id vszybig sndi aa hi an animaiHon or real tSuie eeoie navi^KtSoa the 
xe^onof intereabwlUaothBve&conBten^ - 

S- SXJMR/LAJiy OP MB IN^^ 

AooGsding to att ft^i^t of ^ present Suventfesiy there ia provided a method of gjEmerating ql 9berooBcop!c hnage 
of a scene, the method ocanpHsSng> 

defining at least One first region of ^ ec^Dei 

forming «t ImM cme first ima^ pair» whevdn the or eadi aaid first ima^ pair comprises & first bnage of part 
of a 8^ first r^B of said fioone wh«a viowed fcom a first location, and a seoond is^^ 
regSouL whe4 -viewed torn a aeeoBad loeationt sfpaced ftm. aaid first location; 

carrTing out afirst mappxeg proce^ on a^ least one said first image pair to generate a respoctave first display 
imag? palTi wlieroin the or each s^d first display image pair is edited to be delayed on a display dovjee to 
provide a staeooscopSe Imago (tf said part of said first region; 

defining at leasx one second re^^on of 

fonooing at least o^e $econd bnage pair, wher^ the or each aaid eeeond imago pair compxiaed a thhrd hnagft 
of part of a said second region of said fioet^o ^en viewed llrom a third kicatlon, axid a fo>^rth image of said part 
of said sooandre^on when viewed firom a fonrth location, ^aoed firomsfdd tliSrd location and 
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carrying out a second mapping; ptocesd an at least on& said second ima^ pair to QCiA&retie A. ro^pectrwa fi^coxsd 
display bnag^ ^ctir, whoniln tko or eaciL said second di^pl^y ImCise pdx is adapted to bo displayed <m a ^spl&y 
device to provide a stef^oscoplo imaso of add part of second regllon; 

whexein an dbjtsoi^ having a pxeddcntdnsd dopth in a 'vi&w'iaQig dix^Ctloxi fa a said &rst xegSon has a first 
pcNdved depth when ^aiplaQred <ai a dSfipld^ 

direction in a sa^d d^Mnd xoglm has a second perealvifid dfipih, different torn said £xst psrcasvisd de|st3i, ^^hoA 
displayed on stud didplsy device. 

Aeecsadins to another aspect ol the present &rv4^oxi» tiiere is provided ea flvparatos for CEoaerft^ii^ 4 stereo*- 
ecoplo iteftgo of & BCfino, <^ sppamsitus com priring - 

£rst imase fomSx^ ms^ns Cor foxmSng least one first image pair, wherein the or eaid first imago pair 
cos4>x1SGS a ££8t image of part of a first region of said scene ^bea viewed firom a first iocation, and a fiecODd 
image of said part of said first res^in when "^wed ham- a second location, spaced ttcm ^d first location; 

first mapping means fixr cacxyins ont a firsx moppiUs .process on at least one said drst itna^ pair to generate 
a respeotiye first display ima^ pair, who?^ the or each said first di^ipU^jr UaAge pair is adapted to be displayed 
on a display device to provide a stereoscopic ima^ of said part of said first region'^ 

second Sroas^ fonning mfians for forming at least one seooiid imago pair, whet^oio the or each said second 
image pair cQ^pXiaes a tbird imago of part of a second region of said scene when viewed fcom a third location* 
and afourth lnia,ge of said part of said second zegion whoA vietved from a fiourth location, spaced &om eaid third 
iocatian; and 

second moping .mofttts £c>r caxrylng out a second mapping proc£!$e on at least one ^d second image pair to 
generate a respective second display tmAge pair, wherein the or each s&ld second display image pair is adapted 
to be displayed on a display device to provide a stereoscojfac image of said part of said second region^ . 

wher^^u eiik object hffoing a predetonrdsBd. depth £11 a vie^^ng direction in a said fiist re^n has a first 
p^fidved d€;pth when displayedi oa a divisor dmdce^ and an object IiavSn^ said predetermined depth Itt aviowin^ 
direction in a s^ sechnd x^goik has a second peroeived depth, different ftcm seid first perceived d^f^. when 
disples^ on said dimple;/ devSee. 

4. A THRSXS-KBGION ]0£PXH MAPPING ALGORITHM 

We present a new algorltimi that nses a ti^ree^resioii depth mapping to ov^oome the Gttj'tationa of previous 
aing)^' reglan despth, saiidppini; algorithms and as a result provide new control ovear the way scene deplh is maj>ped 

ytk OOodder two distinct geomotrles; the gconsietiy defining the rcSationsh^p between the viewer and the 
diqplsy and the i^omeQry C< deene and camera. Odxe tOiree-reg^ al^tibm maps the defined regionsi NR, 
fiOI end FR la 'Scene d^pth mto cocraspondiB^ defined ranges of gpd. This wapjfto^ !a zeqnSred to meet the 
COfiStaaiDi t^iat points on the region boundaiSea ave projected to ooinevdeat positions, and, hence dopthi in the 
laiage pair Tvhicheiwrresloti they a» consider T3ke algorithm implementa posipeetive pzojecti 

ee a pSeoewisa continuous fmustlon of Bcene depth and uses a difiierest pcirspective paeojecitioa (dffierent siteroo 
cameras} to capture eaoh of the three regiona 

4.1. IDfsplay Geonatetry 

Thege0mjBtryofdispls(yviewiagisillii8tratedin£i^^ The inewear'^ half e(}<o separation is gjlven by s> the screen 
phme is at distance s from the viewer and tibie half screen width S9 ^ The total working geometric pero^ed 
di^th raz^ is between the planes at dSetancc^ N and F from the viewer. The totdl ^pd lange is divided into 
anear range. NH. [i>^,7^> arcgion of Interest ranset ROT [n,/], and a far range, FR by planes defined at 
44« ffftwi->»Q n ssDjd f from the viewer 

The screen ^isfpsa^itiee of points ^ying on the display vicrecnng centxo line for the planes at distances 
n, /» F ore £^ven by dxx d^, df and dp xed^ectivdb^ Noto, in each case Just she half di^azi^ for one vieer ie 
shown with the matdkidg half from the other view omitted tat eldcxf^ 
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- db^ail^ of palndi Qviib. 



t 



4. Th6 display vjevnmg seomeby fllsm?iflt5 tote)' ajk^ tAnse and ths split Isto ne^Li*. HOI and fi^ regions. 




OcftnanBiKiBonb MFT ' ROT PRf 



FIsuTA 5. lin soaxM jpAoufitiy ibdirin; deftmed aesar, ftOl asd bx vBg^fins of «oeno deiprth and t&a noiK^scQSpio camarft 
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4.2. Seens Geometry 

Tlieg«>aai««yofthe8«aftdtodC^era iaillusfcratedinfilsupeo. \Vq assuma lO^t tlffl imase caeator hais 

A stogtecasa«atli6£ifm«stli6 rebuked viSxF of th^B^^ Tlis total depti lango 5n the scene -we are askod to 

capture is i?'] Add this ia dmdfid into U» neap 

disuncsdn' and /' ton tiie vwwer. These re© ona Tj^m be majipod to the d^ed rangps of jpi on ^ 



In ^ngjfliegjonmfithodfi aaSngle«ewo caa^ ift calcalatftd to poeHioA tike c&rtWia. to take the 

ksft and rig^rt Smag«s. ^ the thyefr-tegio]^ apj^WMwii x^r* need to &3d thrta camera aaparations one o aAfo r the 
KH, ROI and FR regjona. ea2sa!a«>dtkd to detocuba these ara des6rlbad in the foliowhig ihree aecl&ma. 

4.3. Region of Ikatek^6St Mapping 

The ROIxnappmg uses essentiftily the same apprcKU^ as the Jonas algorithm,** although it di£Fc*5 in eomo of 
the meaffoz^entB used for dfisby. 

Tht aim is to map the tt^on of depth in the scene defined aa the ROI Onto the matciiinfi region of ^pd 
idfiDtSfied for the Wtget display A& in the orismal method the di^lay is t^wescntcd in the scene by a. virtual 
display plane. This ello^^s XiS to considca: the mapping of scene depdi onto dlspaiifa the virtual display plana 
s^arasdy him the pbyaleal dSepaxlties on the tai^ot display. 

Con^ering tie geametiy of the display space in figme 4 wis can derive hy edmilpr taa^n^ that tho foltowing 
relatiosish^ hold; 

4.= ^^ 0) 

. . (2) 

Coneidaring the geometry in ihe scene in figure o -we can derive hy smilar trianglea that the Wlowine 
relatiottshtiis hol± . 

(3) 

The link between ttese qasntltfes is that the ratio of the dfepaiftles reroatos the same between the ^spto 
and the virtual display In the scane.^ Intttovdy this to Ito caaa beeai^ 

<£^lay id the eaptured amaea which is the same esxept be a scale fector bebvmn the vhinial diaplay m sme 
]^aaea3«l the pliysicBl display TherstSois: 

Ae axe ^v^*,^,/ and we can dmply calculate the vahie of r. However, vre do not Imow the distance 
to the vfettjaleereanplaiie*' and <rf particular interest the half earner 'We can derive esqpae^WXW 

fiarthosobygubgfcituti^ t^) «ad (4) ixrto (5) aabekran 

r^m^ (6) 
whidb «a can raaxcittgft to glvs &a apqptaat i on Ecur z": 
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"W© ^on now £ud Mlq virtual screen -vidt^ ti/, using the anonosoopic cdmerft field of viow, 

t.^=*'<«n(%) (a) 

ftom -wbkh we @Bt thfl scaling, 5, ibx cBsparltles firom th£ tai^get didplfty t6 tbo virtual scraen. 

*=« (») 

A$ *«fO sSven tJie target diapazity rangjcs on fhs pha^sical screfizx w<& c&n &ci^ c$l0uldtd the dlspaxlt^ xauge^ 
cn tlid '\artu63 doreesi* Then by lean^a^^ng (3) and substituting ^ &= sd^ vre can iind o^* 

'^-^ ao) 

Ti'b ttc^ have almost all the infazmaticaa needed to calculate the left )r%ht 0dmer4 positions and gonoriLte the • 
le& Attd zight porti&S ixoA^ ior tho BOI le^on wfth the exceptslqn of the ««w 5e)d of view; 



This Ss the field of view ior camera with & ^mmetrio firustum and henoe -we must clip a proportion of pixels 
from tbjs lelb and right odges of the left and right partial Imag^ TeS^peCtivBiy- This ensures that points pxcjcctlng 
zero disparity onto the vjirtuel screen plane will also have «ero diaparity when di^layed on the phj^Bical acrocn 
plane. The propoortSoii of pixels to crop is g^vea h^i * ;: 

4.4. Nestf HegEtei Mappmg 

Fy>r t)x« near region (NR) we map the ecena depth bi (/V,n/] tofbe^pd! (JV;«t] nfiing tbs same imagp plene used 
- fir-the lEUU mapping, as slkr^ . 

seed to «nsurO db^t. pohite on the plane at iv* map -to the same position in the final smaga whether they 
are mapped 1^ tho BOt step or ti^e,NR step^ We ean eonMder this to be a constnunt thot tbe 6eid width of the 
ROI camera and the camfira be* the same Sn the plane «t distanoe n' fxsxm the ceme£» locsftSosi. This will 
revolt in a pleoowi^ ocmthmous i^epresentaOoa of aterooaoopie depth vA^th meets at regfon boundaries but ioiay 
noti be amrkHhy contbiuous. 

For the NR me^ypihg we ealeulate a now half camata sc^^^xa'^os a'', a aommetrie field of and the 
associa ted teage cropping, AdditioaaQy we need to calculate an ofi^ adjustment 0^ to shift the NTR diaparity 
range to be oontinuotta wSih the disparity range fiesrth^ ItO^ re^on. 

We &$t cOTKdder the disparity csa the virtual scroea plane of a point ou the planes at the noar region limite 
of end n' when projected fieom a camera at our now near region camera position €^ 

The virtual scxcott diep^t7 of a point on the lar limit the near region at Ea gSven V* 
The virtual screen dlspent^*^ of a point on the near limit of t&e near region at if' hi given 
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Slffur^ 6* Ite &fitt6 ^Mmotiy sbonviqg fSb» variables rolafced tp ^ oesHt t«sl«i imasfl SBttfiratton. 

Wenptatli&t <tjsr-<^ ^'^C^^'"**) Binoc we define K^^r, c^l to be the tMOrgdt aspftrily rrage for the dep^ 
and h^ce. u^g equations (13) and (14), xve Cad o'^ to be: 

Wo now find the «&et correction to tba dlsparii^ on ifaa vlitnal seuea eo thfifb tho near rogion diaparHgr is 
continnon& ^ti^ the I^I ro^n disparytv in ibo virtual soeeoi plane: 

vhero is gJven 1^ (13). Bquation (16) may b« d«k{iie4 l?y mppoction oat hy oonsldcxl^s application of the 
ihooiem^^ to th^ relevant geometrf 
Tho Apld <a vlfiw the NR eaxnora «an now %e ealeolutad If wa know tho half Beld iwidth tp" Sn the vSKtael 
sczoea pfasie vhidx can be found a£ bdbmf* 

to"==ta'-.</' + Q^ o"<a" b/'=u/-a"+</', o">"o'' 07) 

The qnnmetKio fidd of view &r the k£6 «nd right eamocas Is thcoor 

t"-2atafi(^) (IS) 

1h«K« 1$ a naed to crw a proportion, of pfaceb, cT , fieom tho rosnlting hnagps -srhore 

Sf < a" tiion wo crop pSxote feom the left of tho left and tiie ri^ of tlio right imago irihile if o^' >« 
tb^ W6 crop pixds from tho of tho loft Ima^ and Uft of the rigbb image 

We now have the new camera parwcneieite wxd imftge adfluatmonts we nood to render the KR partial hna^o 
for the left and ^Sght views While the projection of the NR and RDI redone will diflfcr hi order to map depth 
dJfferoncly £com eeeno depth to available gpd for oadi region we have ensured tho depth efEwA will be piecfiwlse 
oontSnnous at the region boimdaxy. 
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Fax Roslcn Mapp^ 

For tiie for jegk>n (PR) we need to zoap tbe scene dos^ in [/'^F^] to thd ^ ranee [f,F] rendering oaxto the 
sama iniage plane used for the ROIsoappiitig, as dbc^m I^d nidUiod la direotity Andk>SQ^ 

Qjgoxiihm desoibed above and ifi derived la a siaSlar manner 




Figure T. The scene l y s omet t y «bowtn£ the parameters related to £ur region fanai^e generatioti. 

As far the NR ma|>plng we need to eaianace that pointa on the pLaoe at y map to the sains posltlaa tn the 
final Im&go whether they sct& mapped Ify xho ROI ^b&p Cz tha FR step Wo can contridw thb as a oanstraiot that 
the PR and ROI cameras have the Beld widfih in tho plane y . 

We need to caleulettd a now camera appazation a"' thot wiU xoap lf\^ to ffnlmila t ft t3a« aiymmot^rlc 

field of view, aasoeiated cropping and finally calculate the a^uA nead^d to adjuat l^o diapaxita' raaBga of tha for ^ 
r^^tt to bo pieeenviae cantiniious.wxth that of tha fiur ISmft of tba KOX di^pasity wga. 

We first deterznine tho dSspaxity on t&e virtuai screen plane of a point on oadi of tha planes &.t the far region 
linaita of /' and wheoa projooted fsam a. oasaor^ at our no«7 tar legion caznera poaitioa as below. 

Ilka vimal aar«aa dlflpaxHy of a point on tha naax lin^ 

d^f^ SZ(/'^- . f\> (20) 

Th& vSttnal acvean dlapacily of a point on the ha limit of i^e fiax x^gpon on the plane is gIveiD Isy 

(21) 

Wc n<»« thM ^-dff^ a{iF - df) by defliihko> sines we ace slvea [d/,djt>l as target disparity raage. 
Haaeo from (20) aad (21) «a£bida"'tebo:. 

(^)-(^) 
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-Wbiifiodl ^ calculato the «>rrec*fam to the dispaxity an the virtual Boxoea so l^idt tb6 fex rogion Is eontipoous 
^Ci the ROI: 

(23) 

yrhsTQ iB given by (20). Equatloa (23} m2y bo d&rh/^ by mapectioii cv by applicataon of the bitercepit 
tiieorGm^' to ihe xelevant geoaoe^. 

Tfad £e!d of vlov for tha FH cmm location can be calculated if "we Icnov t(h^ ^dd Trtdtb 

ta"'«*ti»'+</^+a"' (24) 
Xbe eyxmnetric field of *vSew £»r file FR camfisa 18 th«a& 

t*'-2atoa(2£l) (28) 

'n:^ id ihm the need to a4}ust tke zero diapaxily plaa&e 1^ ttoppin^ A proparticm of poxeb £coni tk^ left of 
the lefi image and the right of the ri^hb Ima^ as holowr 

We nowr have the new ce»iere. parameters and image adj^^^^tm^nts w need to render the FH p^i^ images 
{or "ttio left and right viet^ White thp projettlen of th< 5061 ^tnd.ROl re^ns will differ in order to map depth 
dififenmtly &oin scene to display m eadi region we have ensnxed the depth effect wiU be pSecewi3$.co^inuou5 at 
the region boundary. 

5- D^l^EMEOTiA^ 

The thxee-iv^on mapping fiJgoiithm described aWve bae been implemaated u^i^ the POV-Ray lagr tra^g 
^/stem to ^operate images of test scmes^ and application oKamples. 

To ^ the POV-r^y scripts the vset defined a nscaoseoplc cameira position field of viow to frame th^ view 
they tvish to genesrato. They profvlde deCiaiJs the target diaplay indudSiiS the proportkm of the total available 
^ to be ueed txs the FR, ROI «Bd WlL z^lo&s. In addition the total ac^ dsp& and €bo piopartKM? to be 
mapped to the FR, ROI and NR regions are ^edfiod. 

Given the abovo information a eoript la run to analyse the depth ran^a in tbo scone and calculate the 
Bterooscopie camera paramet^ i^t the three corona. Note, that whm rendering the NR» KOI aao^ PR regions 
^ only ^ the scene seometzy withhi each region ao the soipt aleo CaJcnhcUta appropriate chppbag volumes* 
The reatUtinff scripts axe th^ yvn to ^essorato threa paxtial Imagsa tor both &e left and the rii^t vicwa. 

Finally the par^l images aro uierged in depth order from fiu to near resulting M the storeo Inu^ 
can then be (fi^s>layed on the target 3D tSsplay. 

6. It£Stn/73 

The POV-T^ Ksnha 1^ a ^pk> teat scene ate shcnm in figure B. This fihowa the th^ee ve^ltona rendered a^ 
partial hnagea and t^ dteieo pab resulting &om mer^bg the partial images in depth oxdet* 

A comparison of the ledults of the new thro8-»^oa mapping algorithm with an csdaiSng aan^^ie rogion algorithm 
is shown in figure 9 'Hie upper graph in figtire 9 abows how the singia range mapping compressos the region 
o£ intoto^ aloos ^"THh the rest of the scene aa a -nbole into the available p2»2. Tlie lower graph ahowa hov the 
Xhre^rogjon algorithm Is al^e to distribute available ppd pre&rentiaUy io the rc^on of inlereat, in this case the 
ROI is given a one-to-one r^rosentation at the easpense of fixrchck- cODQprtisaion otgpd in the near aaad lar r^slons. 

As wdH as pi^eferemiaUy aUooating availabte porcehi^ depth to the zeg^ of iaoterest ^ new tieteithm has 
ilMbenofitof being able to fix the ^ of the ROI even if the total dx^Q^ Cthemging TlOa 

seems lllcdy to be of sign ificant benofit when, fat ci^ample, moving a game charact«f around a seexko with var3fing 
dqjth range. The deptti r^iesontatlon of the game character can now be fisted M^he^o mA. the previous tdng^e 
rang$ mapping the dtacactor s depth representation ^stdli vary depending on the total seeno depth visible boon 
the eurtent viewpoint 
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Figure 8. The partUU imsi^ ld?k to rigli^f^r the P3t» ICOI «nd NK res)^ a» combised in depiih order to fimn 
stereo pair for this view ahown at &r left. The ozisbuJ jnisj^es are availabia on the author^a wab ^te- 
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Figured. Thex«aaItof (xpp^saaeaeSstSxis ao^ tha new three-7«gK^ alggpithm (lower) 

The scene d^th, «d, &Iazt$ the eibec^ova i» pSomd agai&st tha gBonELetdc perceived depth» spik^ alo^ tbe ordiiiete. Tbe 
wtteel dadked Bftea 5]ikdSeMe thB bcnindex^ 

7. CONCXUSrONS 

^tliis ]f>apdT has px^ooted a now ^ippsca^ to cc^uring scene depth in steceoscopie imas^ scSvd^g problema l^t 
ec39thig methods have sepnsdontki^ ddpth m vt^mst of intexc^t. Xbe Pe»r wpn»dk allcnre cooteat eceatoia to 
dBdfenbute svaSlable pcdroerved d^pth prderGotlal^ to zqglODS Interest Asd keep Htfs magipUig ^onffifiM evan if 
total dceaifi depth is cheaagixig. We pRssenied ansv tHzee-fegiQii algorithm to adiSeve diSs and have demoBstraxed 
Efisulte ficflDoa eaaJgrsie of the algpxithm «cad a molti-pfiee rendexhig ImplemiOEitatloxi vsing tbe POV-r^ ra^ tr&cfng 
system. 

Thid approach will bo i^tiportant is codznated content such as oompntor f"^^ where a game dhareister moves 
around a scene end the total depth in t^sw of the cameras is changing. It also has bemsfita fior apn^tcetlans where 
d^th Judgenacnt i$ cdtioal, sudi as sdeoitlflc and medii^ maging, where an identified xegSoA of mtcrest can be 
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njo^Qed-^om" to maintftin a defined peroohnad depth yepsfe st aaia fc icgL. 

Ebr foturo work the Curronfe approadi cmi be implemented easHy Jcat teal tSmd ^pMcs in the stwidard 
graphics pipetincL We art also easfcendiBs the algorithm from the tbxe^ to Kftul^^gioa mappiBS and in th© 
iimie contlmiotiBly wiabla mapping of sceoe d^ to disp!^ depth. FhiaHy wa ate Interested to jnvestigate 
boor to eombSM ih» nsw a|goriUim wftih other methods tot eoucihrifiif^ percdved deptih, te example biusHng 
if^qpfty^«#« otttside tho region of lutorost- 
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